On Stability of Randomly Switched Nonlinear 

Systems 

Debasish Chatterjee and Daniel Liberzon 

Abstract. This article is concerned with stability analysis and stabi- 
lization of randomly switched nonlinear systems. These systems may 
be regarded as piecewise deterministic stochastic systems: the discrete 
switches are triggered by a stochastic process which is independent of the 
state of the system, and between two consecutive switching instants the 
dynamics are deterministic. Our results provide sufficient conditions for 
almost sure global asymptotic stability using Lyapunov-based methods 
when individual subsystems are stable and a certain "slow switching" 
condition holds. This slow switching condition takes the form of an as- 
ymptotic upper bound on the probability mass function of the number 
of switches that occur between the initial and current time instants. 
This condition is shown to hold for switching signals coming from the 
states of finite-dimensional continuous-time Markov chains; our results 
therefore hold for Markov jump systems in particular. For systems with 
control inputs we provide explicit control schemes for feedback stabiliza- 
tion using the universal formula for stabilization of nonlinear systems. 



§ 1. Introduction 

Randomly switched systems consist of a family of subsystems, together 
with a random switching signal which specifies the active subsystem at every 
instant of time. Since the dynamics are governed by an ordinary differential 
equation between any two successive switching instants, these systems may 
be regarded as piecewise deterministic stochastic systems [6] . These systems 
have variable structure, and can be used as models for systems affected by 
random structural changes. Applications of randomly switched systems in- 
clude economic and manufacturing systems, communication and biological 
systems affected by random delays and component failures, etc. One par- 
ticularly interesting phenomenon is observed in certain sea snails "Pleuro- 
branchea" and "Tritonia."* These organisms have simple neural networks 
and persistent stimuli cause them to swim. Random changes in stimuli, e.g.. 

Key words and phrases, switched systems, random switching, almost sure and mean 
stochastic stability, stabilization. 

*This particular phenomenon was communicated to the authors by P. K. Jha. 
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scent of random food locations or random noxious environmental conditions, 
cause them to take orienting turns towards food, or avoidance turns away 
from the noxious agents, respectively. 

A particular class of piecewise deterministic stochastic systems has re- 
ceived widespread attention, namely, Markov jump linear systems (MJLS). 
These systems may be realized as a family of linear subsystems, together 
with a switching signal generated by the state of a continuous-time Markov 
chain. Stability and stabilization (see [15] for a detailed survey on different 
notions and results on stochastic stability) of MJLS have been extensively 
investigated, especially under the assumption that the parameters of the 
Markov chain are completely known, see e.g. [4, 13, 7, 18] and the ref- 
erences therein. In particular, almost sure stabilization and stabilization 
in the mean of MJLS is discussed in [7], where the authors also establish 
precise equivalences between different stability notions for MJLS. 

In this article we neither restrict ourselves to linear subsystems nor to 
Markov switching signals. Our results provide sufficient conditions for al- 
most sure stability of randomly switched nonlinear systems when each sub- 
system is stable, and the switching is "slow" in a certain statistical sense. 
The slow switching condition takes the form of an upper bound on the 
probability mass function of the number of switches between the initial and 
current time instants. This condition is shown to hold in the case of switch- 
ing signals coming from finite-dimensional continuous-time Markov chains; 
consequently our results can be applied to Markov jump systems under 
appropriate conditions on the parameters of the generator matrices of the 
underlying Markov chains. Since almost sure stability implies stability in 
probability [9], our results also provide sufficient conditions for stability in 
probability of randomly switched systems; a variant of stability in the mean 
is also obtained. Based on our analysis, we propose control schemes which 
achieve almost sure stabilization and stabilization in the mean for systems 
with control inputs, by employing the universal formula for nonlinear feed- 
back stabilization [20]. 

A myriad of techniques have been employed to study stability and sta- 
bilization of piecewise deterministic stochastic systems. HJB-based opti- 
mal control schemes for piecewise deterministic stochastic systems are well- 
studied, see e.g. [6] for a detailed account. Linear control systems admit 
analytically solvable linear quadratic optimal design methods, and such tech- 
niques have been effectively combined with the stochastic nature of struc- 
tural variations in [13]; stabilization schemes based on Lyapunov exponents 
are studied in [7]. Game-theoretic techniques [1] in the presence of distur- 
bance inputs, and spectral theory of Markov operators [12] have also been 
employed to study these systems. Stabilization schemes using robust control 
methods are investigated in [21]; see also the references cited there. Stochas- 
tic hybrid systems, where the switching signal and its transition probabilities 
are state-dependent, are studied in [5, 10], using an extended definition of 
the infinitesimal generator and optimal control strategies, respectively. 
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In contrast to the above references, our techniques rely on the method 
of multiple Lyapunov functions, discussed in the context of stability anal- 
ysis and stabilization of deterministic switched systems in [17, Chapter 3]. 
Our results conceptually parallel the ones on deterministic switched sys- 
tems, which require stability of individual subsystems and a slow switching 
condition, see e.g. [17, Chapter 3]. We employ multiple Lyapunov functions 
for stability analysis and stabilizing controller design, coupled with suitable 
assumptions to take care of the stochastic nature of the switching signal. 
Recently a method of stabilization in probability of Markov jump systems, 
with control and white noise disturbance inputs for each subsystem, has 
been proposed in [2], which is similar in spirit. We propose stronger results 
that apply to a wider class of systems and switching signals, although our 
model is simpler due to the absence of noise. 

§ 2. Preliminaries 

Let the Euclidean norm be denoted by ||-||, the interval [0,oo[ by M^Qj 
and the set of natural numbers {1,2, . . .} by N. Recall that a continuous 
function a : M^o — * I^^o is of class /C if a is strictly increasing with 
a(0) = 0, of class /Coo if in addition a{r) — > oo as r — > oo; we write a G /C 
and a £ /Coo respectively. 

We define the family of systems 

(2.1) X = fp{x), per, 

where the state x G M", P is a finite index set of N elements: V = {1, . . . , N}, 
the functions fp : — > M" are locally Lipschitz, /p(0) = 0, pGV. 

Let {^,^, {dt)t^o,P) be a complete filtered probability space, where 
{dt)t^o be the natural filtration (satisfying the usual conditions) generated 
by a cadlag random process a taking values in V. We let a generate the 
randomly switched system 

(2.2) i = fa{x), x{0)=xo, t^O. 

from the family (2.1). We assume that there are no jumps in the state x at 
the switching instants. Let the switching instants of a be denoted by Tj, i = 
1,2,..., and tq := by convention. As a consequence of the hypotheses 
of our main result, there is no explosion almost surely (see Remark 3.3 for 
details); therefore the sequence (ri)j^o is divergent. Finally, we assume that 
for every compact subset K C M^q ^ I^" there exists an integrable function 
nij^ satisfying sup^g-p ||/p(x)|| ^ rrixi^) (^i^) ^ Hence almost 

surely there exists a unique solution to (2.2) in the sense of Caratheodory [8] 
over a nontrivial time interval containing 0; existence and uniqueness of a 
global solution will follow from the hypotheses of our main result. We let 
x{-) denote this solution. For xq = 0, the solution to (2.2) is identically 
for every a; we shall ignore this trivial case in the sequel. 
We focus on the notion of stability defined below. 
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2.3. Definition. The system (2.2) is said to be globally asymptoti- 
cally stable almost surely (gas a.s.) if the following two properties are 
simultaneously verified: 

(SPl) P(ye > 35 >0 \\xo\\ <5 ^ sup^j^o \\x{t)\\ < e ^ = 1; 

(SP2) p(Vr,e' > 3T ^ \\xo\\ <r ^ supty^ lk(i)|| <e') =1. O 



This definition can be readily recast into the ICC framework as follows. 
The system (2.2) is GAS a.s. if 

P(3/3 G ICC Vxo G Vt ^ \\x{t)\\ ^ /3{\\xo\\,t)) = 1. 

Notice that there is no assertion about uniformity of trajectories; it merely 
states that the state trajectory corresponding to almost every event satisfies 
some class-/C£ bound. 

§ 3. Stability under Random Switching 

§3.1. Global asymptotic stability almost surely. For a switching 
signal a, we denote the number of switches on the interval ]0,t] by N„{t). 
The following main result of this article provides sufficient conditions for 
GAS a.s. of (2.2). 

3.1. Theorem. Consider the system (2.2). Suppose that there exist 
continuously differentiable functions Vp : M" — > IR^O) P ^ 'Pj functions 
ai,a2 G /Coo, and real numbers A, A, Ao > 0, ^ > 1, such that 
(i) ai(||x||) ^ Vp{x) < asdixll) Vx G M", Vp G V; 
dVp 
dx 

(iii) Vp,{x) ^ fiVp,{x) Vx G M", Vpi,p2 G V; 



(ii) ^/p(^) ^ -^oVpix) Vx G M", Vp G V; 



(At)'=e 



k^-Xt 



k\ 



(iv) 3M G NU{0} such thatMk ^ M we have P[N^{t) = fc) ^ 

(v) ^ < (Ao + a) /a. 
Then (2.2) is GAS a.s. 

Before proving Theorem 3.1, let us make the following observations. 

3.2. Remark. Hypothesis ((ii)) of Theorem 3.1 implies that each sub- 
system of the family (2.1) is globally asymptotically stable; the right-hand 
side of the inequality being linear in Vp is no loss of generality, see [16, 
Theorem 2.6.10]. Hypothesis ((iii)) first appeared in [11], and has almost 
become a standard in deterministic switched systems literature. It restricts 
the class of applicable Lyapunov functions by requiring the existence of a 
maximal global constant ratio among the functions, but it is not known 
whether this hypothesis actually incurs a loss of generality. Quadratic Lya- 
punov functions are universally considered for linear systems, and in this 
case the existence of a global constant ^ is automatically guaranteed. Since 



ON STABILITY OF RANDOMLY SWITCHED NONLINEAR SYSTEMS 5 



the left hand side of the inequahty in hypothesis (iv) is a probabiUty mea- 
sure of an event, the right hand side may be replaced by (e~'*'*(At)''/A;!) A 1. 
In the special case when A = A, this hypothesis states that the number of 
switches Nfj{t) on ]0,t] of a is eventually upper bounded by the probability 
mass function of a Poisson process of parameter A. <l 

3.3. Remark. Suppose a satisfies hypothesis (iv) of Theorem 3.1. Then 
the probability of an explosion, i.e., of an accumulation of infinitely many 
switches over a finite time interval is zero. Indeed, if C ^ I^^Oi the event 
that there is an explosion at t = C is given by Hi/gn {-^o-(C) ^ But 
P(n.eN{^<x(C) ^ z^}) ^ ^urooEZuPi^AC) = k), and using hypothe- 
sis (iv), we get ]hRu^ooEk=uP{Na{C)=k) ^ Ih^^.Too Er=. e'^^T = 
Since C £ is arbitrary, we conclude that there is no explosion almost 
surely. < 

The proof of Theorem 3.1 follows the sequence of Lemmas below. The 
idea of the proof may be briefly summarized as follows. The property (SP2) 
is proved flrst by flrst estimating the expected value of Vf^i^t){x{t)) for an 
arbitrary t ^ via the moment generating function of Na{t), and then 
proving a.s. asymptotic convergence of (V^{t) {x{t))^ via Tonelli's theorem 
and an auxiliary Lemma that proves asymptotic convergence of ||x(-)|| from 
the finiteness of a certain nonnegative integral. We also observe that since 
the (finite) family of subsystems is uniformly locally Lipschitz, the maximal 
temporal growth rate of trajectories is upper bounded by a constant in a 
neighborhood of 0. The (SPl) property can now be established utilizing 
this fact and the (SP2) property that is proved first, thereby completing the 
proof. 

3.4. Lemma. Suppose that hypotheses (ii) and (iii) o/ Theorem 3.1 hold. 

Then we have E[V^(^t){x{t))] ^ E [e(''^^)^-W] K(o)(a;o)e-^°* Vt ^ 0. 

Proof. Recall that (ri)^^^ are the switching instants of a. It follows 
from hypothesis (ii) that for t G [Ti,ri+i[, we have 

y.(.,)(x(t))^y.(.,)(x(r,))e-^°(*--»). 

In conjunction with hypothesis (iii), this yields 

y.(,,^,)(x(r,+i)) ^ ^K(,^)(x(r,))e-^°(^'+^-^»). 

Iterating the last inequality from i = to i = N^{t) for an arbitrary time 
t > 0, we arrive at 

^.w(^W)^/^^"^*^e-^°V,(o)(xo). 

Since the initial condition is deterministic, taking expectations on both sides 
of the above inequality we get 

E[y,(,)(x(t))] ^ e[^^-W] e-^°V^(o)(:Eo), 

which proves the claim. □ 
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3.5. Lemma. Suppose that hypothesis (iv) o/ Theorem 3.1 holds. Then 
3S ^ such that the moment generating function E[e'*^'^^*^] of N„{t) sat- 

isfies E [e^^-(*)] ^ 5 + e(<=^^-^)* V s ^ 0. 

Proof. Using hypothesis (iv), for s ^ a httle computation leads to 

oo 
k=0 

sfe(At)'^e 



E 



A:=0 k=M 



k=M 



where S := Efcio^ ^ 0- Clearly, E[e"^-(*)] is well defined for t^O. □ 

The following Barbalat-type lemma will be needed to conclude asymp- 
totic convergence of the state trajectory from the finiteness of an integral. 

3.6. Lemma. Suppose that 
• Qi G /C, and 

ai{\\x{t)\\)dt < oo a.s. 



Then P lim x{t) =0 =1. 

Vt— >oo / 

Proof. Suppose that the claim is false. Then with positive probability 
there exists some e' > and a monotone increasing divergent sequence 
(sj)jgN in IK^o such that Q;i(||rE(sj)||) > e' for all i. (Of course, the sequence 
depends on the event in the aforesaid set of positive probability.) Since 
{fp}p£'P is a locally Lipschitz and finite family of vector fields, there exists 

some e" > and L^// > such that sup pg-p^ 11/^(2^)11 ^ -^e" ll^^ll- Let 

lkl|e[o,'£"[ 

e := e' A e" . Note that G R"\{0} 



(3.7) l]o,e[(x(t)) 



d \\x 



dt 



^ Lr \\X 



By the finiteness condition on the integral in the hypothesis, almost surely 
there exists T{e) > such that 



In 2 



(3.8) / ai(||x(t)||)dt < - / aiUe-^-Mds 



T(e) 2 7o V2 

where the right hand side is a strictly positive quantity since oi G /Coo- 
By construction, (si)igN is a monotone increasing divergent sequence with 
y{si) > £ with positive probability, and therefore there exists i^e) G N such 
that > T(e) with strictly positive probability. By continuity of ||-|| 
and x(-), there exists an instant t' > Sj(£) such that ||x(t')|| = e/2, also with 
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positive probability. But by (3.7) we have ||a;(t)|| G ]0, e[ for all t G ]t', t'+^-f^[, 
and therefore 

^ -te ' L. 



ai(||x(t)||)dt^^^ «,(^£e-^.(*-0^dt 



with positive probability, which is a contradiction in view of (3.8). The 
thesis follows. □ 

3.9. Lemma. The system (2.2) has the following property: for every 
e > there exists > such that ||2;(t)|| ^ ||xo|| e^=* Vt ^ as long as 
\\x{t)\\<e. 

This is a standard calculation that employs the locally Lipschitz condi- 
tion on the set of vector fields {fp}pep- 

Proof of Theorem 3.1. To prove that (2.2) is gas a.s., we need to 
verify the (SPl) and (SP2) properties in Definition 2.3. 

From Lemma 3.4 and Lemma 3.5 it follows that Jg°° E[V^(()(x(t))] dt < 
oo, and by Tonelli's theorem we have 



E[y,(,)(x(t))] dt 



Uo 



K(t)(rE(t))dt 



< oo. 



By hypothesis (i) we get Jq°° ai(||x(t)||)dt < oo a.s., and Lemma 3.6 shows 
that limt_>oo ||a^(t)|| = a.s., which proves (SP2) 

Now we verify (SPl). Fix e > 0. We know from the (SP2) property 
proved above that almost surely there exists T(l,e) > such that ||xo|| < 
1 implies sup4^7i(;^ £') ||x(t)|| < e. Select (5(e) = min {ee~^=-^(-^''^\ l}. By 
Lemma 3.9, \\xq\\ < (5(e) implies 

||x(t)|| ^ llxoll e^-* < <5(e)e^-^(^'") < e Vt G [0,T(l,e)]. 

Further, the (SP2) property guarantees that with the above choice of 5 and 
xq, we have supj^j.^;^ ||x(t)|| < e on a set of full measure. Thus, ||xo|| < (5(e) 
implies sup^^g ||3;(t)|| < e a.s. Since e is arbitrary, the (SPl) property of (2.2) 
follows. 

We conclude that (2.2) is GAS a.s. □ 

3.10. Remark. Besides gas a.s., global asymptotic stability in the mean 
is another important stability concept. The system (2.2) is said to be globally 
asymptotically stable in the mean (gas-m) if the following two properties are 
simultaneously verified: 

(SMI) Ve>0 36 >0 \\xo\\ < 5 implies sup^^o E[||x(t)||] < e; 

(SM2) Vr,e'>0 3f^0 \\xo\\ < r implies sup^^^ E[||x(t)||] < e'. 

We have seen that under the hypotheses of Theorem 3.1 we have convergence 
of (ai(||a;(t)||))^>Q to in Li. If ai is convex, then this immediately gives 
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linif^oo E[||x(t)||] = via Jensen's inequality,^ which is (SM2). Lemma 3.4 
and Lemma 3.5 show that sup^^g E[ai(||2;(t)||)] ^ a2(||a^o||)(5' + 1), which 
under the assumption that ai is convex, implies (SMI). In practice the 
Lyapunov functions are usually taken to be polynomial powers of the state 
X and Qi is convex. Otherwise a property analogous to GAS-M still holds, 
with ai(||x(t)||) replacing ||x(t)|| everywhere, and therefore depends on the 
choice of ai. <\ 

3.11. Remark. With a slight modification in the hypotheses of Theo- 
rem 3.1 we can employ standard results in martingale theory to conclude 
almost sure global asymptotic convergence of x(-). Indeed, if the condi- 
tion ((iv)) is strengthened to the conditional version 

P(N,it + s)-N„{t) = k\:St) ^e-" ' 



kl 

for A; G N U {0}, t ^ 0, s > 0, then a calculation in the spirit of Lemma 3.4 
shows that (K-(j)(x(t)))^^Q is a supermartingale. Lemma 3.4 also shows 

that limt^oo E[V^(t)(3^(0)] = 0> which implies that the aforesaid process 
is a potential. A standard result in martingale theory (e.g., [14, p. 18, 
Problem 3.16]) now implies that the process (^o-{t) (2^(0))t>o converges to 
a.s. Considering hypothesis (i) of Theorem 3.1 we conclude that (||a;(i)||)^>Q 
converges to a.s. < 

§ 3.2. Markov jump systems. We note that hypothesis (iv) of Theo- 
rem 3.1 stipulates that Vt G M^o the tail of the probability mass function of 
the random variable iVo-(i) is majorized (i.e., stochastically dominated) by 
the probability mass function of a "maximally" switching jump-stochastic 
process. This hypothesis can be verified, in particular, if a is the state of a 
continuous-time Markov chain, with a given generator matrix Q = [%]nxN 
and a given initial probability distribution tt° (recall that N is the num- 
ber of elements of V); we denote this by cr ~ {11°, Q). Lemma 3.13 and 
Corollary 3.20 make this statement precise. 

Let us recall some basic facts about continuous-time Markov chains, see 
e.g. [19] for further details. Associated with the Markov chain a ^ {tt°, Q) 
is the Kolmogorov forward equation 

P{t) = P{t)Q, P(0)=/nxN, i^O, 

where /^xN N-dimensional identity matrix; the probability (row) vec- 

tor at any time t ^ is given by 7r(t) = Tr° P{t). We need the following two 
facts: 

(MCI) The generator matrix Q = [gij]NxN satisfies (g^j ^0 i j), and 
(EjePx{i} = -la) for i,j G V. 



^We recall Jensen's inequality [3, p. 80]: if X is an integrable real- valued random 
variable on (fi, 5, P), and if (/> : R — > R is a convex function, then (^(E[|X|] ) ^ E[<j!>(|X|)] . 
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(MC2) P{a{t + /i) = j I a{t) = i) = 6ij + qijh + o{h) for h > 0, and 5ij is 
the Kronecker delta. This is known as the infinitesimal description 
of a continuous-time Markov chain. 
We define 

(3.12) q := max {\qii\ \ i e V} , q := ma.x{qij \i, j £ V} . 

The following lemma establishes a coarse estimate of the probability 
mass function of Nfj{t); a finer estimate can be obtained from the Levy 
formula, but for our purposes the one derived below is sufficient. 

3.13. Lemma. Suppose that a ~ (7r°,Q) is a Markov chain. Then Vt G 
M^o, we have P{N^{t) = A;) ^ e-^\qtf/k\ Vfc G NU {0}. 

Proof. For t e M>o and k G NU{0}, define ^(t) := P{N„{t) = k). For 
h>0 sufficiently smaU, V A; G N U {0}, 

(3.14) rjk{t + h)=Y, P{NAt + h)- N^{t) = i) P{N^{t) = k - . 

i=0 

By the infinitesimal description of a Markov chain (MC2), 

(3.15) P(iVa(t + h)- N^{t) =0) ^l-qh + o{h), 
and 

(3.16) P{N^{t + h)- N„{t) = 1) ^qh + o{h). 
For all natural numbers k ^ 2, (MC2) shows that 

(3.17) P{N^{t + h)- N^{t) = k) =o{h). 

Using (3.15), (3.16) and (3.17), we continue the calculation in (3.14): 

7]k{t + /i) ^ (1 - g/i + o{h))rik{t) + {qh + o(/i))%„i(t) + o{h), 
which leads to 

'^'^'^'l-'^'^'U -qmit)+m-.it) + oih). 

Taking limits with h I 0, the following differential inequality is obtained: 

m{t) ^-qm{t) + qm-i{t), %(o) = o, v/cgn. 

(We have identical differential inequalities starting with t > and h < 
sufficiently small.) A similar analysis yields 

m{t) ^ -qvo{t), %(o) = 1. 

In matrix notation, the set of differential inequalities involving t)^, k £ 
NU {0}, stands as: 

(3.18) 







-q ••• 




Vo 




^o(O) 




1 


m 




q -q ••• 




m 




m(o) 







m 


q -q ■■■ 




m 


5 


^2(0) 
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where the is interpreted component- wise. Clearly, rjo{t) ^ e"*?*, t ^ 0, 
satisfies the first differential inequality. We claim that 

(3.19) %(t) ^ e-«*(gt)Vfc! Vt^O VA;GN 

is a solution to (3.18). Indeed, for /c = 1 we have fji ^ qilo~Q'ni ^ ^e"''*— g?7i, 
which leads to 



e%(t) ^e%(0) + g / ds; 

Jo 



hence r/ie'^* ^ (qt) (in view of ?7i(0) = 0), yielding r]i{t) ^ (gt)e~'^*, t ^ 0. 
Having verified the claim for k = 1, an induction argument shows that for 
arbitrary j 

e^%+i{t) ^ e^*7?,+i(0) +q f ^d.; 

Jo J- 

hence Ty^+ie'^* ^ {qiy~^^/U + 1)' (i^i view of ?yj+i(0) = 0), yielding rij^i{t) ^ 
Q~'^^{qty~^^/{j + 1)!, t ^ 0. In view of the definition of r]k{t), the thesis of 
the Lemma follows. □ 

3.20. Corollary. Consider the system (2.2), and let q,q be defined 
by (3.12). Suppose that a ~ (7r°,Q) is a Markov chain, and that there exist 
continuously differentiable functions Vp : M" — > 1R>0) p & V, functions 
ai,a2 G ICoo, and a real number ^ > 1, such that 

(i) ai(||x||) ^ Vp{x) ^ a2{\\x\\) Vx G M", Vp G V; 
dV 

(ii) -Q^fpi^) ^ ->^oVp{x) Vx G M", Vp G 

(iii) Vp,ix) ^ /uyp,(x) Vx G M", Vpi,p2 G 

(iv) ^ < (Ao + q)/q. 
Then (2.2) is GAS a.s. 

Proof. Follows directly from Lemma 3.13, and Theorem 3.1 with M = 
in hypothesis (iv). □ 

§ 4. Stabilization of Randomly Switched Control Systems 

In this section we establish a method for designing controllers that ensure 
almost sure global asymptotic stability of control-affine randomly switched 
systems in closed loop. The method may be viewed as an application of our 
results in §3. We assume that at each instant of time t the state a{t) G V 
of the random switching signal is perfectly known to the controller. 

Consider the affine in control switched system: 

m 

(4.1) X = fa{x) + ^ ga,i{x)ui, x(0) = xo, t^ 0, 

i=l 

where x G is the state, Uj, i = 1, . . . , m are the control inputs, Ui G M, 
fp and gp^i are smooth vector fields on M", with /p(0) = 0,gp_j(0) = 0, 
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for each p £ V,i £ {1, . . . , m}. With a feedback control function Uo-(x) 
[ua,i{x), . . . , Ua,m{x)] , the closcd loop systcm stands as: 



(4.2) 



i=l 



Our objective is to select the control function Ua so that (4.2) is GAS a.s. 
Let the switching signal cr be a stochastic process as defined in §2, and let 
xo^O. 

A universal formula for stabilization of control-affine nonlinear systems 
was first constructed in [20], for the control taking values in M™. 

4.3. Theorem. Consider the system (4.1). Suppose that a satisfies hy- 
pothesis (iv) o/ Theorem 3.1, and there exists a family of continuously dif- 
ferentiable functions Vp : — > ^^o, p £ V, such that 

(CI) hypothesis (i) o/ Theorem 3.1 holds; 

(C2) hypothesis (iii) o/ Theorem 3.1 holds; 

(C3) 3 Ao > such that V x G M" \ {0} andVp^V 

(C4) Ve > 35 > such that if x{^ 0) satisfies \\x\\ < 5, then 3u G 
M", ||ii|| < e, such that \f p e V 

m 
i=l 



(C5) hypothesis (v) o/ Theorem 3.1 holds. 
Then the feedback control 



Uaix) = [k„,i{x) 



, . . . , h(j rn (x) 



where 
(4.4a) 
(4.4b) 

(4.4c) 

and 

(4.4d) 



kp,i{x) := -Lg^^Vpix) ■ if(Wp{x),Wp{x)^ 
Wp{x) :=Lf^Vp{x) + XoVp{x), 

m 

1=1 



ifb^O, 
otherwise, 



renders (4.2) GAS a.s. 
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Proof. The proof relies on the construction of the universal formula 
in [20]. Fix t £ M^o- If x 7^ 0, applying the definition of f, we get 

m 
1=1 

< -AoV;(t)(x). 

Since t is arbitrary, we conclude that the above inequality holds for all 
t £ M^o- Note that by (C3), if for any p £ V, x £ fll^Li ker [Lg^^Vp), we 
automatically have Lj^^^^T^-^^) (x) + AoT4.(t)(x) < 0. (C4) is the small control 
property, ensuring continuity of the control function at for each fixed index 
p; this guarantees the existence of a unique local solution to the switched 
system. 

The above arguments, in conjunction with (CI) and (C2) enable us to 
conclude that the family (l^)pg-p satisfies hypotheses (i), (ii) and (iii) of 
Theorem 3.1 for the closed loop system (4.2). (C5) ensures that hypoth- 
esis (v) of Theorem 3.1 holds for (4.2). Since a satisfies hypothesis (iv) 
of Theorem 3.1, it follows from Theorem 3.1 applied to (4.2), that (4.2) is 
GAS a.s. □ 

§ 5. Conclusion and Further Work 

We have provided sufficient conditions for almost sure stability of ran- 
domly switched systems, together with control strategies for almost sure 
stabilization for systems with control inputs. It may be possible to improve 
upon the proposed results by utilizing the jump destinations of the switch- 
ing signal, and in the case of Markov chains, its graph and the associated 
transition probability matrix. Stabilization of randomly switched systems 
with control inputs without perfect knowledge of cj is a nontrivial and impor- 
tant issue. Input-to-state stability properties, existence and uniqueness of 
invariant measures, and other asymptotic properties of randomly switched 
systems are interesting avenues for future research. Results on these will be 
reported elsewhere. 
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